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-In  this  paper  we-pese  and  answer  two  questions  about  solutions  of  the  Unear  complementar¬ 
ity  problem  (LCP).  The  first  question  is  concerned  with  the  conditions  on  a  square  matrix 
M  which  guarantee  that  for  every  vector  q ,  the  solutions  of  LCP  ( q ,  M)  are  identical  to  the 
Karush-Kuhn-Tucker  points  of  the  natural  quadratic  program  associated  with  ( q ,  M).  In 
answering  this  question  we  introduce  the  class  of  row  sufficient”  matrices.  The  transpose 
of  such  a  matrix  is  what  we  call  “column  sufficient.  ”^The  latter  matrices  turn  out  to  furnish 
the  answer  to  our  second  question  which  asks  for  the  conditions  on  M  under  which  the 
solution  set  of  ( q ,  M)  is  convex  for  every  q.  In  addition  to  these  two  main  results,  wedtseuss 
the  connections  of  these  two  new  matrix  classes  with  other  weU-known  matrix  classes  in 
linear  complementarity  theory. 
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SUFFICIENT  MATRICES  AND  THE 
LINEAR  COMPLEMENTARITY  PROBLEM 


by  R.W.  COTTLE1,  J.-S.  PANG2,  and  V.  VENKATESWARAN3 


1.  Introduction. 

The  present  investigation  belongs  to  a  long-standing  tradition  in  the  study  of  the  linear 
complementarity  problem  ( q,M ): 

q  -1-  Mz  >  0 

2  >  0 

zT(q  +  Mz)  =  0. 

A  feasible  linear  complementarity  problem  (q,  M)  is  one  for  which 

F(q,  M)  =  {  z  :  q  +  Mz  >0,  z  >  0  }  /  0. 

Naturally,  F(q,M)  is  called  the  feasible  set  of  ( q,M ).  The  problem  ( q,M )  is  solvable  if 
S(q,M)  =  {z:ze  F(q,  M),  zT(q  +  Mz)  =  0,  }  ?  0. 

In  this  paper,  we  introduce  a  class  of  matrices  (called  “row  sufficient”  matrices)  which 
characterizes  a  certain  property  of  the  linear  complementarity  problem.  We  say  that  a 
matrix  is  “column  sufficient”  if  its  transpose  is  row  sufficient,  thereby  obtaining  a  second 
class  of  matrices.  We  demonstrate  that  the  class  of  column  sufficient  matrices  characterizes 
another  interesting  property  of  the  same  problem.  In  addition  to  these  two  main  results, 
we  discuss  the  connections  of  these  two  new  matrix  classes  with  other  well-known  matrix 
classes  in  linear  complementarity  theory. 

Matrix  classes  have  always  played  a  prominent  role  of  the  theory  of  the  linear  comple¬ 
mentarity  problem  (LCP).  Indeed,  even  before  the  LCP  had  been  given  a  name,  Samelson, 
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Thrall  and  Wesler  [23]  showed  that  for  fixed  M  €  Rn*n,  the  LCP  ( q,M )  has  a  unique 
solution  for  every  q  £  Rn  if  and  only  if  M  belongs  the  class  P  of  matrices  with  positive 
principal  minors.  This  theorem  is  one  of  several  wherein  an  interesting  property  of  the 
linear  complementarity  problem  actually  characterizes  a  class  of  matrices.  Of  course,  by 
virtue  of  the  equivalence,  the  characterization  goes  both  ways. 

Our  point  of  departure  for  this  study  is  an  analytic  (as  opposed  to  constructive)  proof 
technique  that  has  been  used  by  several  authors  for  demonstrating  the  existence  of  a  so¬ 
lution  to  a  feasible  linear  complementarity  problem.  This  technique  does  not  work  in  all 
cases,  but  it  does  for  linear  complementarity  problems  involving  positive  semi-definite  ma¬ 
trices  [3]  among  others  [5].  This  raises  a  question:  What  is  the  scope  of  the  technique,  i.e., 
the  class  of  all  matrices  for  which  it  works?  Our  characterization  result  (Theorem  4)  shows 
that  this  class  consists  precisely  of  the  row  sufficient  matrices. 

An  extension  of  the  existence  result  [3]  is  due  to  Adler  and  Gale  [1]  who  show  that  a 
feasible  LCP  ( q ,  M)  with  a  positive  semi-definite  matrix  Af  has  a  nonempty  convex  poly¬ 
hedral  solution  set.  This  raises  a  second  question:  What  kinds  of  linear  complementarity 
problems  have  convex  solution  sets?  We  give  more  than  one  characterization  in  answer  to 
this  question.  Interestingly  enough,  one  such  characterization  is  intimately  related  to  the 
answer  to  the  first  question.  (See  Theorem  6.) 

2.  The  Associated  Quadratic  Program. 

There  is  a  close  and  much-noted  connection  between  the  LCP  (q,  Af)  and  the  quadratic 
program 

minimize  <f>(z)  =  q*z  +  zTA/z 

subject  to  q  +  Mz  >  0  (1) 

z  >  0. 

The  feasible  set  of  (1)  is  precisely  F(q,M).  In  order  to  compensate  for  the  fact  that  M 
may  be  asymmetric,  it  is  customary  to  use  the  equivalent  representation  of  the  objective 
function: 

0(z)  =  qTz  +  %zT(M  +  MT)z.  (2) 

It  is  clear  that  for  any  M  6  RnXn  and  q  £  Rn ,  any  solution  of  (g,  M)  is  an  optimal  solution 
of  (1).  However,  the  converse  of  this  observation  is  not  valid  unless  the  optimal  objective 
function  value  of  (1)  happens  to  be  0.  Part  of  this  paper  will  characterize  certain  instances 
when  any  Karush-Kuhn-Tucker  point  of  (1)  will  be  a  solution  of  the  LCP  ( q,M ). 

The  following  lemma  is  extracted  from  the  proofs  of  several  earlier  existence  theorems. 


(Cf.  [3],  [4],  [5].)  It  is  included  here  because  of  its  strong  motivating  influence. 
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Lemma  1.  Let  ( q,M )  be  a  feasible  LCP.  Then,  the  quadratic  program  (1)  has  an  optimal 
solution,  zm.  Moreover,  there  exists  a  vector  u*  of  multipliers  satisfying  the  conditions 

}  +  (]/  +  MV-MV>  0  (3) 

(Ot[9  +  (A/  +  MV-A/tu*]  =  0  (4) 

u*  >  0  (5) 


(u*)T(9  +  Mr*)  =  0. 


Finally,  ihe  vectors  zm  and  u*  satisfy 


(z‘ -  um)i[MT(z*  -  um)\i  <  0  for  all  t  =  1, . . . ,  n.  (7) 

Proof.  Since  ( q,M )  is  feasible,  so  is  the  quadratic  program  (1).  As  the  objective  function 
of  the  quadratic  program  is  bounded  below  on  the  feasible  region,  it  follows  from  the  Frank- 
Wolfe  Theorem  [9]  that  there  exists  an  optimal  solution  to  (1).  Such  an  optimal  solution 
2*,  together  with  a  suitable  vector  u’  of  multipliers  will  satisfy  the  Karush-Kuhn-Tucker 
conditions  (3)  -  (6).  (See  [17].)  To  prove  (7),  we  examine  the  inner  product  (4)  at  the 
componentwise  level  and  deduce  that  for  all  i  =  1, . . . ,  n 

z:\M\z-  -  u*)],  <  0  (8) 

using  the  fact  that  z“  is  feasible.  Similarly,  multiplying  the  i-th  component  in  (3)  by  u* 
and  then  invoking  the  complementarity  condition  u’(q  +  Mr*),  =  0  which  is  implied  by 
(5),  (6),  and  the  feasibility  of  2*,  we  obtain 

—  u*[A/T(r*  —  u*)]i  <  0.  (9) 

Now,  (7)  follows  by  adding  (8)  and  (9).  ■ 

Remark.  Conditions  (3)-(9)  Eire  satisfied  by  any  local  minimum  for  (1)  and  corresponding 
vector  of  Lagrange  multipliers.  It  is  not  necessary  to  assume  that  2*  is  a  global  minimum 
for  (1).  As  we  shall  see  below,  the  stronger  conclusion  of  global  optimality  may  also  be 
inferred  under  some  circumstances. 

3.  Sign  Reversing. 

From  the  standpoint  of  this  paper,  the  most  important  conclusion  of  Lemma  1  is  em¬ 
bodied  in  the  system  of  inequalities  (7)  which  say  that  MT  “reverses  the  sign'1  of  2*  —  u\ 
Credit  for  this  terminology  is  due  to  Gale  and  Nikaido  [13]  who  define  concept  as  follows. 
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Definition.  The  matrix  M  £  RnXn  reverses  the  sign  of  the  vector  x  £  Rn  if  x,(Mx),  <  0 
for  all  i  =  1, . . . ,  n. 

It  helps  the  discussion  somewhat  to  consider  the  set,  rev  M,  of  all  vectors  whose  sign  is 
reversed  by  a  given  matrix  M  £  Rnxn: 

rev  M  =  {  x  :  ii(Mi),  <0,  t  =  1, . . .  n}. 

Note  that  for  all  M  £  Rnxn,  rev  M  contains  the  zero  vector.  In  general,  rev  M  is  a  cone 
(not  necessarily  convex)  containing  ker  M,  the  kernel  (nullspace)  of  M.  The  conditions 
under  which  rev  M  and  ker  M  are  equal  can  be  characterized  through  the  notion  of  column 
adequacy  (defined  below).  A  special  result  of  this  kind  can  be  found  in  the  1962  paper  [10] 
by  Fiedler  and  Ptak  who  gave  several  equivalent  conditions  for  a  matrix  M  to  belong  to 
P.  One  pair  of  them  (namely,  1°  and  2°  in  their  Theorem  (3,3))  amounts  to  saying  that 

M  £  P  if  and  only  rev  Af  =  {0}. 

Several  discussions  in  this  paper  concern  submatrices  and  subvectors.  Since  such  objects 
are  described  in  terms  of  rows  and/or  columns  of  specific  matrices  and  vectors,  this  requires 
the  use  of  notation  pertaining  to  index  sets.  Relative  to  the  positive  integer  n,  an  index 
set  a  is  either  a  subset  of  {1, . . . ,  n}  of  the  form  {ij, . . . ,  i*}  where  1  <  ti  <  •  •  •  <  t*  <  n 
or  else  the  empty  set.  If  a  C  {1, . . . ,  n}  is  an  index  set,  then  d  is  the  (complementary) 
index  set  obtained  by  taking  the  elements  of  the  set  {1, . . . ,  n}  \  a  in  their  natural  order. 
For  a  given  matrix  M  and  index  set  a,  the  matrix  Ma.  (M.a)  denotes  the  submatrix  of  M 
consisting  of  the  rows  (columns)  indexed  by  a.  When  M  £  Rnxn,  its  principal  submatrices 
can  be  expressed  as  Maa  where  a  C  {1, . . .  ,n}. 

Definition.  Let  M  £  Rnxn  be  a  matrix  with  nonnegative  principal  minors.4  Then  M  is 

(i)  row  adequate  if  for  all  a  C  {1, ...  ,n} 

det  Mao  =  0  <=>  the  rows  of  M.a  are  linearly  dependent, 

(ii)  column  adequate  if  for  all  a  C  {1,  •  •  • ,  n} 

det  Maa  =  0  <=>■  the  columns  of  M0.  are  linearly  dependent, 

(iii)  adequate  if  it  is  row  and  column  adequate. 

4The  class  of  real  square  matrices  whose  principal  minors  are  all  nonnegative  is  denoted  Po- 


The  class  of  adequate  matrices  was  introduced  by  Ingleton  [14]  to  capture  some  of  the 
properties  of  positive  semi-definite  matrices  vis-a-vis  the  LCP.  In  [15],  Ingleton  identified 
the  three  matrix  classes  described  in  the  preceding  definition.  The  concept  of  row  adequacy 
also  appeared  in  the  work  of  Eaves  [8],  [9].  It  is  obvious  that  every  P-matrix  is  adequate. 
Ingleton  [15,  1.2.3]  noted  the  converse:  every  nonsingular  adequate  matrix  belongs  to  P. 
The  proof  of  this  given  in  [5,  Lemma  3]  can  be  modified  to  show  the  following  very  slight 
generalization. 

Lemma  2.  Let  M  £  Rnxn  be  nonsingular.  Then  M  is  row  (column)  adequate  if  and  only 
if  M  £  P.  ■ 

For  ease  of  reference  and  as  motivation  for  our  new  results,  we  state  the  following  known 
theorem  in  detail. 

Theorem  3.  Let  M  £  Rnxn.  Then 

(a)  M  is  row  adequate  if  and  only  if 

x ,( A/Tx),  <  0  for  all  »  =  1, . . . ,  n  =>  MTx  =  0. 

(b)  A/  is  column  adequate  if  and  only  if 

x,(Mx)i  <  0  for  all  t  =  1, . . . ,  n  =>•  Mi  =  0. 


Proof.  Part  (a)  was  proved  by  Eaves  [8],  [9,  Lemma  (20),  p.622].  Part  (b)  follows  from 
part  (a).  ■ 


There  is  a  more  elegant  way  to  state  Theorem  3.  The  matrix  M  £  Rnxn  is 

(a)  row  adequate  if  and  only  if  rev  MT=  ker MT 

(b)  column  adequate  if  and  only  if  rev  M  =  ker M. 


These  characterizations  of  (row  and  column)  adequacy  inspire  the  more  general  notion  of 
(row  and  column)  sufficiency.  Before  giving  the  definition,  we  define  a  special  mapping. 


Definition.  For  A/  £  Rnxn,  let  h\i  :  Rn  —*  Rn  be  the  mapping  x  *-»  x*Mx,  the  Hadamard 
product  of  x  and  A/x.  Thus,  for  every  x  £  Rn ,  h\i(x)  is  the  n-vector  (x,(Afx),). 


Note  that  for  any  M  €  Rnxn, 


rev  Af  =  {  x  :  h\f(x)  <  0  }. 
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To  facilitate  the  language,  we  let  revh\f  =  rev  M  and  then  put 


ker  hM  =  {  x  :  hM{x)  =  0  }. 

The  relation  ker  h\f  C  rev  h\f  is  automatic.  When  the  reverse  inclusion  holds  for  the 
M  and/or  A/T,  we  get  the  notions  of  sufficiency. 

Definition.  The  matrix  M  €  RnXn  is 

(i)  row  sufficient  if 

i,(AfTx)j  <  0  for  all  i  =  1, . . .  ,n  ==>  x,(MTx),  =  0  for  all  t  =  1, ...,  n,  (10) 

(ii)  column  sufficient  if 

Xi(Mx)i  <  0  for  all  i  =  1, . . .  ,n  =>  xl(Mx)i  =  0  for  all  i  =  1, . . .  ,n,  (11) 

(iii)  sufficient  if  it  is  row  and  column  sufficient. 

Alternatively,  we  can  say  that  M  €  iT*xn  is 

(a)  row  sufEcient  if  revh^r  =  kerh^r, 

(b)  column  sufEcient  if  rev  h\f  =  kerhjv/. 

Row  sufficient  matrices  and  column  sufficient  matrices  must  belong  to  the  class  P0. 
This  follows  from  the  Fiedler-Ptak  (8]  characterization  of  Po  which  says  that  the  matrix 
M  €  Rn*n  fl  P0  if  and  only  if  for  every  nonzero  vector  x  €  Rn  there  exists  an  index 
k  €  {1, . . . ,  n}  such  that  x*  ^  0  and  x*(Mx)*  >  0. 

We  note  the  following  facts. 

(i)  Positive  semi-definite  matrices  axe  sufficient,  but  not  necessarily  adequate. 

(ii)  Row  (column)  adequate  matrices  are  row  (column)  sufficient. 

(iii)  There  are  row  (column)  sufficient  matrices  which  are  neither  positive  semi-definite 
nor  row  (column)  adequate. 

(iv)  Every  principal  submatrix  of  a  row  (column)  sufficient  matrix  is  row  (column)  suffi¬ 
cient. 
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4.  The  Role  of  Row  Sufficiency. 

In  Section  2,  we  saw  (Lemma  1)  that  when  the  quadratic  program  (1)  associated  with 
the  LCP  ( q,M )  is  feasible,  there  must  exist  a  Karush-Kuhn-Tucker  pair  ( zm,u‘ )  such  that 
A/T  reverses  the  sign  of  zm  —  u*.  We  now  link  this  fact  with  the  property  of  row  sufficiency 
of  the  matrix  A/. 

Theorem  4.  Let  Af  €  RnXn.  The  following  two  statements  are  equivalent: 

(a)  M  is  row  sufficient. 

(b)  For  each  vector  q  €  Rn,  if  (r*,u*)  is  a  Karush-Kuhn-Tucker  pair  of  the  quadratic 
program  (1),  then  z *  solves  the  LCP  ( q,M ). 

Proof,  (a)  =>  (b).  Effectively,  it  was  shown  in  Lemma  1  that  zm  —  u*  €  revhMr.  When  M 
is  row  sufficient,  zm  —  um  €  ker  t.  Thus,  for  all  i  =  1, . . . ,  n, 

<|mV  -  «-)),  =  u-[mV  -  „•)],. 

Combining  this  with  (4),  (8)  and  (9),  we  deduce  that 

z'(q  +  A/2*),  =0  for  all  t  =  1, . . . ,  n. 

It  now  follows  that  zm  solves  ( q,M ). 

(b)  =>  (a).  Suppose  Af  is  not  row  sufficient.  Then  there  exists  a  vector  x  6  rev  hM-r 
such  that  x}(MTx)j  <  0  for  some  j.  Without  loss  of  generality,  we  may  assume  x}  >0. 
We  now  use  the  vector  x  to  develop  a  contradiction  to  (b).  To  this  end,  let  zm  =  x+,u*  = 
x",  and  q  =  —  Mz“  +(MTx)~ .  It  is  then  easy  to  show  that  (2*,  u*)  is  a  Karush-Kuhn-Tucker 
pair  for  the  quadratic  program  (1)  defined  by  the  given  M  and  the  constructed  q.  We  now 
obtain  a  contradiction.  By  construction,  2*  >  0  and  (q  +  Mz'),  >  0,  yet  according  to  (b), 
the  vector  2*  solves  ( q,M ).  ■ 

Remarks.  This  theorem  has  a  some  important  implications. 

1.  Row  sufficient  matrices  belong  to  the  class  Q0  consisting  of  all  real  square  matrices 
A/  for  which  the  feasibility  of  ( q ,  M)  implies  its  solvability.  Thus,  we  conclude  that 
row  sufficient  matrices  belong  to  P0  fl  Q0  and  that  every  LCP  of  this  type  can  be 
“processed”  by  Lemke’s  algorithm  [18].  See  Aganagic  and  Cottle  [2,  p.230]. 


2.  The  row  sufficiency  property  precisely  delimits  the  class  of  matrices  for  which  the 
analytic  existence  proof  technique  via  K-K-T  pairs  of  the  quadratic  program  (1)  will 
work.  Thus,  we  have  now  answered  the  first  question  asked  in  Section  1. 

3.  The  preceding  remark  and  the  existence  of  other  matrix  classes  belonging  to  Q0 
lead  one  to  speculate  about  the  possibility  of  finding  other  analytic  methods.  The 
copositive-plus  matrices  introduced  by  Lemke  [18]  (see  also  Cottle  and  Dantzig  [6]) 
exemplify  a  familiar  class  of  matrices  that  need  not  be  row  sufficient. 

5.  The  Role  of  Column  Sufficiency. 

In  this  section  we  address  our  question  on  the  convexity  of  the  solution  set  S(q,M)  of 
an  LCP  (q,.\f).  We  begin  with  a  preliminary  theorem  which  is  reminiscent  of  the  Adler- 
Gale  [1]  characterization  of  the  solution  set  of  ( q,M )  when  M  is  positive  semi-definite. 
Much  more  general  results  were  obtained  by  Jansen  [16]  who  studied  the  structure  of  the 
solution  set  of  an  arbitrary  LCP  ( q,M ).  Jansen  showed  that  S(q,M)  is  the  finite  union  of 
polyhedral  sets. 


Theorem  5.  Let  M  6  RnXn  and  q  €  Rn  be  given.  The  following  statements  are  equiva¬ 
lent: 


(a)  The  solution  set  of  ( q,M )  is  polyhedral. 


(b)  The  solution  set  of  ( q,M )  is  convex. 

(c)  The  equation 

{zx)\q  +  Mz2)  =  (z2)T(q  +  Mz1)  =  0  (12) 

holds  for  any  two  solutions  zl  and  z 2  of  ( q,M ). 


(d) 


There  exist  complementary  index  sets  a  and  a  contained  in  {1, . . . ,  n)  such  that  every 
solution  to  ( q,M )  satisfies 


qa  d"  —  0, 

q a  +  Mao 2a  >  0, 

2o  >  0, 

Zs  =  o. 


(13) 


Proof,  (a)  =>  (b).  This  is  obvious  as  all  polyhedral  sets  are  convex. 


(b)  =>  (c).  Let  z1  and  z 2  be  any  two  solutions  of  ( q,M ).  By  the  convexity  assumption, 
the  vector  z  =  rz1  +  (1  —  r)z2  is  also  a  solution  for  any  r  £  (0,1).  By  letting  w'  — 
q  +  A t z'  (i  =  1,2),  we  have 

0  =  [ rw 1  +  (1  —  t)w2]t[tz1  +  (1  —  r)z2]  =  r(l  -  r)[(u)1)Tz2  +  (u;2)1^1] 
from  which  (12)  follows. 

(c)  =>  (d).  The  desired  index  set  is 

a  =  { i  :  z,  >  0  for  some  z  £  S(q,  M)  }. 

It  follows  that  i  £  a  if  and  only  if  Z{  =  0  for  all  z  £  S(g,  M).  Let  z  £  5(9,  M)  be  arbitrary. 
It  suffices  to  show  that  wa  =  qa  +  Maaza  =  0.  Now  choose  an  arbitrary  i  £  o.  Then  z,  >  0 
for  some  z  £  S(q,M).  By  (12),  with  z1  =  z  and  z2  =  z ,  we  deduce  that  wt  =  0.  Thus 
wa  =  0,  and  (d)  follows. 

(d)  =>  (a).  Let  Z  denote  the  solution  set  of  (13).  Then  Z  is  clearly  a  polyhedral  subset 
of  5(9,  M).  ■ 

Theorem  5  gives  necessary  and  sufficient  conditions  for  the  convexity  of  S(q,M),  but 
only  for  the  individual  vector  q.  In  the  theorem  below,  we  remove  this  restriction,  thereby 
obtaining  a  universal  result  in  terms  of  M  alone.  The  proof  of  the  theorem  is  reminiscent 
of  Murty’s  proof  in  [21]  of  the  Samelson- Thrall- Wesler  characterization  of  the  class  P. 

Theorem  6.  Let  M  £  Rnxn.  The  following  two  statements  are  equivalent: 

(a)  For  each  vector  q  £  Rn ,  the  LCP  (9,  M)  has  a  (possibly  empty)  convex  solution  set. 

(b)  M  is  column  sufficient. 

Proof,  (a)  =»  (b).  Suppose  M  is  not  column  sufficient.  Then  there  exists  a  vector 
x  such  that  xx(Mx)t  <  0  for  all  :  =  l,...,n  and  Xj(Mx)}  <  0  for  some  j.  Now  let 
z1  =  x+  and  z2  =  x~ .  For  brevity,  let  u+  =  (Mx)+  and  u~  =  (Mi)”.  Define  the  vector 
9  =  u+  —  A lx+.  Notice  that  9  =  u~  —Mx~  also.  It  is  not  difficult  to  verify  that  z1  and  z2  are 
both  solutions  of  (9,  M)  with  the  so-defined  9.  Nevertheless,  we  have  either  zl](q+Mz2)J  >  0 
or  z2(q  +  Mzl)j  >  0  depending  on  whether  Xj  >  0  or  Xj  <  0.  This  contradicts  the  convexity 
of  the  solution  set  of  (9,  M). 

(b)  (a).  Let  9  £  Rn  be  given.  We  may  assume  ( q,M )  has  at  least  two  solutions,  for 

otherwise  there  is  nothing  to  prove.  Let  z*  and  z2  be  two  solutions  of  (9,  M)  and  define 


t vk  =  q  +  Mzk  for  k  =  1, 2.  Then,  for  each  i  =  1, . . . ,  n,  we  have 


0  >  (zl  -  *2),(u>1  -  w2)i  ~  ( z1  -  z2)i[M(zl  -  zJ)]i.  (14) 

By  the  column  sufficiency  of  M,  the  terms  on  the  right-hand  side  of  (14)  must  equal  zero, 
and  hence  equality  must  hold  throughout.  In  particular,  z}w2  =  z2 w}  =  0  for  i  —  1, . . . ,  n. 
Since  this  is  just  a  version  of  (12),  the  convexity  follows.  ■ 

A  characterization  of  sufficient  matrices  cam  now  be  obtained  by  combining  Theorems  4 
and  6. 

Corollary  7.  Let  M  G  Rnxn.  The  following  two  statements  are  equivalent: 

(a)  For  each  q  G  /2n,  the  set  of  Karush-Kuhn- Tucker  points  of  the  quadratic  program  (1) 
is  convex  and  equal  to  S(q ,  Af). 

(b)  M  is  sufficient. 

Another  way  to  look  at  the  universal  convexity  question  is  through  the  geometry  of 
the  complementary  cones  relative  to  M .  Complementary  cones  were  first  introduced  by 
Samelson,  Thrall  and  Wesler  [23]  and  later  studied  in  the  LCP  context  by  Murty  [21].  To 
carry  out  this  part  of  the  analysis,  we  recall  two  important  definitions. 

Definition.  Let  A  €  RnXm.  Then  the  positive  cone  spanned  by  A  is  the  set 

pos(A)  =  {y  :  y  =  Ax,  x>0}. 

For  any  matrix  A ,  pos(A)  is  a  convex  (finitely  generated)  cone.  It  is  well  known5  that  the 
relative  interior  of  pos(A)  is  precisely  the  set  of  all  strictly  positive  linear  combinations  of 
the  columns  of  A.  That  is, 


ri  (pos  ( A ))  =  {  y  :  y  =  Ax,  x  >  0  }. 


(15) 


Definition.  Let  M  €  /r'xn  be  given.  For  each  a  C  {1,  •  •  • ,  n}  let  C\f(a )  denote  the  matrix 
specified  by 


(CM(a)U 


—M.i  if*  Go 
I.i  otherwise 


sSee  for  example  Rockafellar  [22,  Theorem  6.9]. 
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Sets  of  the  form  pos (Cjvf(a))  are  called  complementary  cones  (relative  to  A/).  (For  discus¬ 
sions  of  complementary  cones  relative  to  a  single,  fixed  matrix,  A/,  we  simplify  the  notation 
by  dropping  the  subscript  A/.) 


The  connection  between  complementary  cones  and  the  solvability  of  an  LCP  is  well 
known:  An  LCP  (q,A/)  has  a  solution  if  and  only  if  q  G  posC(a)  for  some  a.  In  general, 
two  complementary  cones  C(a)  and  C(0)  may  be  equal  for  distinct  index  sets  a  and  0. 
Part  of  the  following  result  asserts  that  this  cannot  be  the  case  if  S{q,M)  is  convex  for 
every  q. 

Theorem  8.  Let  M  G  f?nxn.  The  following  two  statements  are  equivalent. 

(a)  For  each  vector  q  G  Rn,  the  LCP  (q,M)  has  a  (possibly  empty)  convex  solution  set. 

(b)  The  distinctly  generated  complementary  cones  (relative  to  M)  have  disjoint  relative 
interiors;  that  is, 

ri  (pos  C(a))  fl  ri  (pos(  C(0))  =  0  for  all  a,  0  C  {  1, . . . ,  n  },  a  /  0. 

Proof,  (a)  =>  (b).  Suppose  there  exist  distinct  index  sets  a  and  0  such  that 

ri  (pos  C(a))  fl  ri  (pos(  C{0))  ^  0. 

Let  U  =  C(a)  and  V  =  C(0).  We  may  assume  that  there  is  tin  index  k  such  that  U, k  = 
I.k  and  V ,k  =  —M.k.  Now  let  q  6  ri  (pos  C(a))  fl  ri(pos(  C(0))  be  arbitrary.  Then  (as  in 
( 15)  above)  there  exist  positive  scalars  and  /x,  (*  =  1, . . . ,  n)  such  that 

q  =  ±K 

i=i 

Define  zl,tvl,r2,  and  w 2  by  the  rules 

A,  i  G  a 
0  j  G  d 

f  p.  *  €  0 

j  0  i  G  0 


1=1 

(  0  i  G  a 
(A,  i  G  a 

2  /  0  '*0 
w,  =  s 

Ip,  » €  0 


Thus,  z1 ,  z2  G  S{q ,  A/).  But  k  £  a  C\  0.  Hence 


which  contradicts  Theorem  5. 


(b)  ^  (a).  Again,  the  proof  is  by  contradiction.  Suppose  there  exists  a  vector  q  €  Rn 
such  that  S(q,  M)  is  not  polyhedral.  Then  there  exist  two  solutions  of  (q,  M)  for  which  (12) 
is  violated.  The  idea  is  now  to  use  this  information  to  construct  a  vector  q  that  belongs  to 
the  relative  interiors  of  two  distinctly  generated  complementary  cones. 

From  the  above,  it  follows  that 

q  = 

i=i  t=i 

where  for  some  index  fc,  we  have  U.k  =  I.k ,  V.k  =  -M.*,  A k  >  0,  and  Hk  >  0.  Let 
7  =  {  i  :  U.i  =  V.i  }.  Then  we  can  write 

9=£a.£/.,  +  £a1c/.. 

i€7  i€*r 

iey 

Next  define  the  following  index  sets: 

=  {*  €  7  :  A,  >  0,  m  =  0}, 

h  =  {  *  G  7  =  A<  =  0,  ^  >  0  }, 

S3  =  {  i  <=  7  :  A,  =  0,  Hi  =  0  }, 

64  =  {  i  €  7  •  Ai  >  0,  Hi  >  0  }• 

By  its  definition,  k  6  64  which  is  therefore  nonempty.  Now,  using  the  two  representations 
of  q,  define 


9  =  9  +  £  tf.,  +  X>.,  +  £tf.i 

*€$i  u^3  *€^2  *€*7 

=  £(A,  +  1)^7.,  +  £  v\<  +  X)  +  £  A, -If.,-  +  £(A,  +  1  )U.i 

ieSj  ieSj  ieSt  »e  7 

=  E  +  E(f.  +  i)v..  +  Et;-  +  E  + B* + up- 

*€$i  «€^2  i€$3  »€$4  *€-y 

An  examination  of  the  index  sets  and  the  coefficients  in  these  equations  reveals  that  q  has 
been  represented  as  a  vector  belonging  to  the  relative  interiors  of  two  distinctly  generated 
complementary  cones,  namely  C(a)  and  C(@)  where  Jfc  €  a  D  0,  thereby  making  a  ^  0.  M 

12 


6.  A  Special  Case. 


Generally  speaking,  the  implication  (11)  through  which  column  sufficiency  is  defined 
involves  nonline ar  inequalities  and  all  vectors  x  G  Rn.  In  this  section,  we  consider  linear 
complementarity  problems  ( q,M )  in  which  the  matrix  M  belongs  to  Z,  the  class  of  real 
square  matrices  with  nonpositive  off-diagonal  elements.  Much  has  been  written  about  this 
class  of  matrices  in  the  LCP  context  and  otherwise.  See  for  instance  [7]  and  the  references 
therein.  The  main  result  of  this  section,  Theorem  9,  shows  that  if  M  is  a  Z-matrix,  then 
the  implication  (11)  can  be  restricted  to  only  the  nonnegative  vectors  x  G  Rn.  In  turn, 
this  restricted  implication  is  equivalent  to  a  finite  set  of  linear  inequality  systems.  The 
upshot  of  the  theorem  is  that  if  M  G  Z,  then  the  column  sufficiency  property  of  M  and 
the  universal  convexity  of  solution  sets  of  the  associated  linear  complementarity  problems 
can  be  tested  by  a  finite  procedure.6 

Theorem  9.  Let  M  be  a  Z-matrix  of  order  n.  The  following  four  statements  are  equivalent. 

(a)  For  all  q  G  Rn,  if  ( q,M )  is  feasible,  then  S(q,M)  is  polyhedral. 

(b)  For  all  a  C  {1, . . . ,  n}  the  system 

0  #  MQQxa  <0,  xa  >  0  (16) 

has  no  solution. 

(c)  For  all  x  >  0,  x  G  rev/iM  implies  x  G  \aevh\f. 

(d)  The  matrix  M  is  column  sufficient. 


Proof,  (a)  =4  (b).  Suppose  (b)  is  false,  i.e.,  that  for  some  a,  (16)  has  a  solution  xa.  We 
shall  now  construct  a  solvable  LCP  ( q,M )  for  which  S{q,M)  is  not  polyhedral.  Indeed, 
define  a  nonnegative  vector  q  so  that  qa  =  —Maaxa  and  qg,  >  —M6axa.  Now  define  z  so 
that  za  =  xa  and  =  0.  Then  z  G  S(q,M).  Since  q  >  0,  it  follows  that  0  G  S(q,Al).  But 
zT(q  4-  MO)  >  0,  for  za  >  0  and  0  ^  qa  >  0.  We  now  have  a  contradiction,  for  by  Theorem 
5,  S(q,M)  must  not  be  polyhedral. 


(b)  =s>  (c).  If  the  nonnegative  vector  x  belongs  to  rev  h\f  and  not  to  ker  h\f ,  then  x  must 
be  nonzero.  It  follows  that  a  =  { i  :  x,  >  0  }  is  nonempty  and  xQ  is  a  solution  of  (16)  in 
contradiction  to  the  hypothesis. 

6The  transpose  of  a  Z-matrix  is,  of  course,  a  Z-matrix.  Hence,  in  this  case,  row  sufficiency  is  also  finitely 
testable. 
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(c)  =►  (d).  Assume  x  €  rev  h^.  Using  the  Z-property  of  M ,  we  can  show  that 


ii(Mx)i  >  |i,|(Mjij)j  for  all  i  =  1, . . .  ,n, 

where  |x|  denotes  the  vector  whose  t-th  component  is  |x,|.  Thus,  |x|  belongs  to  rev  hM,  and 
since  |x|  >  0,  it  follows  from  (c)  that  |x|  £  ker  h\f.  Accordingly,  we  have 

0  >  £i(Mx)i  >  |xi|(Mjx|),  =  0  for  all  i  =  1, . . .  ,n. 

Hence  x  £  ker/ijv/,  as  required. 

(d)  =>■  (a).  This  is  immediate  from  Theorems  5  and  6.  ■ 

Example.  We  have  observed  that  row  and  column  sufficient  matrices  belong  to  P0.  We 
might  then  inquire  whether  the  converse  holds  for  Z-matrices.  Does  M  £  Z  0  P0  imply 
that  M  is  sufficient?  (Since  M  £  Z  fl  P0  if  and  only  if  A/T  £  Z  D  P0,  there  is  no  point  in 
asking  about  row  or  column  sufficiency  separately.)  The  answer  is  “no,”  for  the  Z-matrix 

1  -1  ' 

0  0 

has  nonnegative  principal  minors,  and  the  vector  xT  =  (1, 2)  belongs  to  rev  hM  \ker  hM .  The 
same  vector  with  o  =  {1, 2}  gives  a  solution  to  (16),  showing  that  condition  (b)  of  Theorem 
9  is  not  satisfied.  For  results  on  linear  complementarity  problems  with  M  £  Z  fl  P0,  see 
Mohan  [19],  [20], 

Linear  complementarity  problems  with  Z-matrices  are  known  to  have  two  particularly 
interesting  features.  First,  they  belong  to  the  class  Q0.  Thus,  whenever  the  polyhedral 
set  F(q,M)  is  nonempty,  then  so  is  S(q,  M).  Second,  when  F(q,M)  is  nonempty,  S{q,M) 
contains  a  vector  z'  such  that  z*  <  z  for  every  z  £  F(q,M).  The  vector  z*  is  called  the 
least  element  of  F(q,  M).  It  is  clear  that  such  a  vector  must  be  unique.  Thus,  a  feasible 
linear  complementarity  problem  with  a  Z-matrix  has  a  unique  least-element  solution,  set. 

As  a  concluding  result,  we  show  that  the  least-element  solution  provides  an  interesting 
structural  property  of  the  solution  set  of  a  linear  complementarity  problem  (q,  M)  in  which 
M  is  a  Z-matrix. 

Theorem  10.  Let  Af  £  Z  and  assume  that  F(q,M)  ^  0.  Let  wm  =  q  +  Mz *  where  z*  is 
the  least-element  solution  of  (<?,  M).  Then 

z  £  S(q,  M)  <=»  z  -  z*  £  S{u>m,M). 


M 
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Proof.  Let  z  €  S(q,M).  Then  £  =  z  —  zm  >  0.  Since  z  €  S(q,M),  we  have 

u>*  +  A/£  =  q  4-  Mz *  4  =  9  4-  Mz  >  0. 

Moreover, 

o  <  £T(u>*  4  A/O  =  (2  -  2*)t(9  4  A/2)  =  —  ( 2* )T( q  4  Mz)  <  0. 

This  implies  £T(u>*  4  A/O  =  0  and  hence  that  £  €  S(wm,M). 

Conversely,  let  £  €  S(w',M).  Then  z  =  2*  4  £  >  0,  and 

q  4-  Mz  =  q  +  Mz *  4  A/£  =  w’  4  A/£  >  0. 

It  follows  from  the  definitions  that 

zT(q  4  Mz)  =  (2*  4  0TK  +  A/O  =  (2*yV*  +  A/O-  (17) 

Now  if  (w*  4  A/O.  >  0,  then  =  0  because  £  €  S(tv*,M).  This  implies  (A/Oi  <  0  since 

A/  e  Z  and  2  >  0.  Combining  these  observations,  we  note  that  u>*  >  0  and  hence  2*  =  0. 

Accordingly,  we  deduce  that  (2*)T(u>*  4  AfO  =  0>  which  by  equation  (17)  implies  that 
2  €  S(w*,M).  U 

Remark.  Theorem  10  says  that  S(q,M)  =  zm  4  5(u;*,A/).  This  is  noteworthy  for  two 
reasons.  First,  S(w‘,  M)  is  the  solution  set  of  a  problem  based  upon  an  LCP  in  which  the 
constant  column  is  a  nonnegative  vector.  Second,  the  solution  set  S(q,  A/)  is  a  translate  (by 
2* )  of  another  solution  set,  S(wm,  M).  Hence  S(q,  M)  is  polyhedral  if  and  only  if  S(wm,  M) 
is  polyhedral. 
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Abstract 


In  this  paper  we  pose  and  answer  two  questions  about  solutions  of  the 
linear  complementarity  problem  (LCP).  The  first  question  is  concerned  with 
the  conditions  on  a  square  matrix  M  which  guarantee  that  for  every  vector 
q,  the  solutions  of  LCP  (q,M)  are  identical  to  the  Karush-Kuhn-Tucker 
points  of  the  natural  quadratic  program  associated  with  (q,M).  In  answering 
this  question  we  introduce  the  class  of  "row  sufficient"  matrices.  The 
transpose  of  such  a  matrix  is  what  we  call,  "column  sufficient."  The  latter 
matrices  turn  out  to  furnish  the  answer  to  our  second  question  which  asks  for 
the  conditions  on  M  under  which  the  solution  set  of  (q,M)  is  convex  for 
every  q.  In  addition  to  these  two  main  results,  we  discuss  the  connections 
of  these  two  new  matrix  classes  with  other  well-known  matrix  classes  in 
linear  complementarity  theory. 


